Use of suboptimal control arms in randomized clinical trials of investigational cancer drugs in China, 2016–2021: An observational study

Background The use of suboptimal controls in randomized trials of new cancer drugs can produce potentially unreliable clinical efficacy results over the current standard of care and expose patients to substandard therapy. We aim to investigate the proportion of randomized trials of investigational cancer drugs that used a suboptimal control arm and the number of trial participants at risk of exposure to suboptimal treatments in China. The association between the use of a suboptimal control and concluding statistical significance on the primary endpoint was also examined. Methods and findings This observational study included randomized controlled trials (RCTs) of cancer drugs that were authorized by specific Chinese institutional review boards between 2016 and 2021, supporting investigational new drug applications of these drugs in China. The proportion of trials that used a suboptimal control arm and the total number of trial participants at risk of exposure to suboptimal treatments were calculated. In a randomized trial for a specific condition, a comparator was deemed suboptimal if it was not recommended by clinical guidelines published in priori or if there existed a regimen with a higher level of recommendation for the indication. The final sample included 453 Phase II/III and Phase III randomized oncology trials. Overall, 60 trials (13.2%) adopted a suboptimal control arm. Among them, 58.3% (35/60) used comparators that were not recommended by a prior guideline for the indication. The cumulative number of trial participants at risk of exposure to suboptimal treatments totaled 18,610 by the end of 2021, contributing 15.1% to the total number of enrollees of all sampled RCTs in this study. After adjusting for the year of ethical approval, region of participant recruitment, line of therapy, and cancer site, second-line therapies (adjusted odds ratio [aOR] = 2.7, 95%CI [1.2, 5.9]), adjuvant therapies (aOR = 8.9, 95% CI [3.4, 23.1]), maintenance therapies (aOR = 5.2, 95% CI [1.6, 17.0]), and trials recruiting participants in China only (aOR = 4.1, 95% CI [2.1, 8.0]) were more likely to adopt a suboptimal control. For the 105 trials with publicly available results, no statistically significant difference was observed between the use of a suboptimal control and concluding positive on the primary endpoint (100.0% [12/12] versus 83.9% [78/93], p = 0.208). The main limitation of this study is its reliance on clinical guidelines that could vary across cancer types and time in assessing the quality of the control groups. Conclusions In this study, over one-eighth of randomized trials of cancer drugs registered to apply for regulatory approval in China used a suboptimal comparator. Our results highlight the necessity to refine the design of randomized trials to generate optimal clinical evidence for new cancer therapies.


Introduction
An investigational new drug has to demonstrate efficacy and establish its safety profile through clinical trials prior to receiving market approval, with randomized controlled trials (RCTs) considered as the "gold standard" for evaluating new drugs [1,2].When designing an RCT, sponsors or investigators choose control groups prudently since they affect the inferences that can be drawn from the trial, the ethical acceptability of the trial, and the acceptability of the results by regulatory authorities [3].Under the Declaration of Helsinki, the effectiveness of a new medical intervention, if applicable, must be evaluated against those of the best-proven interventions at present [4].However, previous research has shown that 17% (16/97) of cancer drug approvals of the United States Food and Drug Administration (FDA) between 2013 and 2018 were supported by RCTs that used suboptimal controls [5].That is, the control agent had not been recommended by a relevant guideline or had been demonstrated to be inferior to available therapy.Similarly, 7 of 49 (14%) RCTs investigating drugs for multiple myeloma in the US randomized participants to control arms despite the availability of alternative regimens proven to have superior clinical efficacy [6].More recently, there has been growing concern about the selection of inappropriate control arms in trials of metastatic castrate-resistant prostate cancer [7,8] and hematological malignancies [9][10][11].
Adopting a suboptimal control group in a cancer drug registration RCT may bias its results in favor of the experimental arm and compromise its probability of informativeness in evolving treatment landscape as the comparator does not reflect the current standard of care.Information from new cancer drug trials with an inferior control group would confound regulatory decision-making by regulators or oncologists [12,13].Moreover, participants in RCTs are exposed to uncertain benefits and risks of investigational new therapies [14].It was estimated that an FDA approval required more than 12,000 pre-license trial (also called the investigational new drug) participants and that around 110,000 patients were enrolled in trials that did not lead to an FDA approval [15].Using suboptimal comparators in RCTs, especially unlicensed agents or regimens, can expose vulnerable patients to unnecessary substandard therapy and produce unconvincing comparative efficacy results of new cancer drugs over the existing standard of care [16].Of the 387 oncology RCTs published in 11 major journals between 2017 and 2021, 43 (11%) were deemed to have a suboptimal control, with a total of 9,505 patients assigned to the suboptimal treatment arms [17].At the core of considerations in an ethical review are principles of respect for persons, beneficence (do not harm and maximize possible benefits and minimize possible harms), and justice [18], hence, research resources could be more effectively utilized if institutional review boards (IRBs) embrace their responsibilities by ensuring that each trial receives meaningful scientific review [19].
The past decade witnessed a large number of oncology trials [20,21] and new cancer drug approvals in China [22,23].Since 2016, more than 200 cancer drug clinical trials have been initiated in mainland China annually [20].In November 2021, the Centre for Drug Evaluation at China's National Medical Products Administration (NMPA) issued the Guidance on Clinical Value-Oriented Oncology Drug Research and Development, it suggests that an active control arm should be selected with consideration of whether it reflects the optimal treatment in current clinical practices [23,24].There is no empirical evidence, however, about the appropriateness of the control arm of these cancer drug clinical trials.Moreover, the association between the quality of the control arm and trial results was rarely scrutinized.In this observational study, we aim to identify randomized oncology registration trials using suboptimal control arm in China and estimate the number of trial participants at risk of receiving suboptimal treatments.For RCTs with published results, we further investigated the proportion of trials with statistically significant results on their primary endpoint and examined the association between the adoption of a suboptimal control arm and concluding statistical significance.

Data sources
We obtained clinical trials registered on China's NMPA Registration and Information Disclosure Platform for Drug Clinical Studies by December 31, 2020 [25].This publicly available website was launched in 2012.In September 2013, China's Food and Drug Administration (now known as the NMPA) required that all clinical trials (including bioequivalence trials, pharmacokinetics trials, Phase I, II, III, and IV trials) authorized by the agency for investigational new drug applications should be registered on this platform [26].Trial information, including the trial identifier, drug name, indication, sponsor, location, trial phase, study design, treatment, eligibility criteria, endpoints, institutions, ethical approval date, start date, status, and enrollment, are disclosed and made publicly accessible on the website [20].
We referred to Chinese oncology guidelines to determine whether the trials in our study sample used a suboptimal control arm.We first examined guidelines published by the Chinese Society of Clinical Oncology (CSCO).CSCO started publishing guidelines for various cancer types in 2016 and has been updating them annually or every other year.The development of CSCO Guidelines follows the level of evidence and expert consensus [27].CSCO categorizes evidence-based recommendations into Grade I (Evidence level 1A and some Evidence level 2A), II (Evidence level 1B and some Evidence level 2A), and III (Evidence level 2B and 3).For cancer types without a specific CSCO guideline, we searched clinical practice guidelines published by other academic societies listed in the China National Knowledge Infrastructure and/ or the WanFang Database (see Box A in S1 Text for search terms and strategies).The review adhered to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guideline (see S1 PRISMA Checklist).This study did not involve patient data, and, thus, the ethical approval was waived by the IRB of Peking University Health Science Center.Written informed consent was not required.

Sample selection
From all clinical trials registered on the NMPA platform, we used a prespecified list of search terms in Chinese (see Box B in S1 Text for further details) to identify Phase II/III and III oncology RCTs conducted among adult patients and approved by any IRB between January 1, 2016 and December 31, 2021.We included trials investigating small-molecule entities (i.e., chemotherapeutic agents and molecule-targeted drugs) and biologics.Trials investigating traditional Chinese medicines, diagnostic products, and prophylactic vaccines were excluded (Fig 1).For each trial, we extracted data on its specific indication(s), inclusion and exclusion criteria, intervention, and control arm for analysis.Trials were categorized by the year of first ethical approval, study phase, cancer site, line of therapy, applicant type (China's domestic versus multinational company), and region of participant recruitment (international multicenter versus China-only).

Definition of suboptimal control arm
For each trial in our sample, we defined the quality of the control arm as suboptimal if (1) the control was not recommended by the concerned clinical practice guideline for a specific indication issued prior to the trial's IRB approval (i.e., different from the regimen recommended in guidelines published before the trial's IRB approval); (2) the control drug or regimen was specified in the guideline but not the recommended regimen (e.g., the control arm was a single agent when the guideline published before the trial's IRB approval recommended doublet therapy); and (3) the control arm was among the recommended list of therapies but there existed a drug (or drugs) with a higher level of recommendation (e.g., the control regimen had a Grade II recommendation while an alternative drug had a Grade I recommendation; see Box 1 for more details).
For multinational trials, in consideration of the delay in new drug approval between China and other countries [28], we further reviewed the Drugs@FDA database [29] to check whether the control regimen had been approved in the US, where most new cancer therapies were approved first [30], before its date of IRB approval in China.If a multinational trial encompassed a specific indication on which a treatment consensus had not been reached in China, we checked whether there existed a standard of care in the former National Comprehensive Cancer Network (NCCN) Guidelines, which have a worldwide influence on clinical practice [31], at that time.Moreover, given the time lag in updating clinical guidelines [32], we also investigated whether a potentially suboptimal control regimen was deemed optimal in any revised guidelines later.Regimens that had been approved by the FDA, recommended as a standard-of-care in the NCCN guideline, or recommended in subsequent Chinese guidelines were recategorized as "potentially optimal control." Box 1. Criteria used to judge the quality of a control arm in randomized controlled trials to be suboptimal ➢ Category 3. The control arm was among the recommended list of therapies, but there existed a drug (or drugs) with a higher level of recommendation e.g., In CTR20171558, a second-line therapy for HER2-negative, estrogen receptor-positive breast cancer progressed after nonsteroidal aromatase inhibitors, the comparator was placebo in combination with exemestane.According to Chinese Society of Clinical Oncology Guideline for Breast Cancer (2017 Edition), fulvestrant was recommended as the basic treatment strategy, while aromatase inhibitors in another mechanism of action were recommended as an alternative.
Two investigators (D.C. and Z.L.) independently extracted information about the indication and eligibility criteria of all RCTs and matched corresponding guideline recommendations for further investigation.The initial agreement rate achieved 94.9% (n = 430/453).Another investigator (Y.Z.) resolved disagreements.Three oncologists (S.C., L.Y., and Q.L.) and an oncology pharmacist (W.L.) independently reviewed the control arm to identify suboptimal control arms.Disagreements were resolved by consensus.

Identification of publication of sample trials
For each trial, we used a stepwise approach to systematically search for peer-reviewed publications of its results [33], given the results submitted to the NMPA Registration and Information Disclosure Platform for Drug Clinical Studies are not publicly available.First, we searched ClinicalTrials.gov(the US National Library of Medicine database of clinical trials) using Study IDs (or Study Title/Acronym when necessary) to match with their National Clinical Trial number.Second, we searched MEDLINE (via PubMed) using the National Clinical Trial number and reviewed all corresponding publications.If no publication was found through these 2 steps, we further searched PubMed for RCTs using a precision-maximizing search strategy and a combination of terms including the drug's name (if unavailable, drug code) and indication [22].
We reviewed the titles and abstracts of all records to identify the primary publications reporting trial results.Among all eligible publications, we extracted information about a trial's primary endpoints (i.e., statistical analysis plan, trial results, and statistical significance).If more than one publication reported trial results, we relied on the initial one that reported the preplanned analysis of the primary endpoint(s).We also examined the availability of a prespecified statistically significant benefit of the sample RCTs.For trials set coprimary endpoints, the results were deemed as statistically significant if the difference between the experimental and the control group was considered to be statistically significant for at least one endpoint.

Outcome measures
The primary outcomes were the annual proportion of trials with a suboptimal control arm and the number of trial participants exposed to suboptimal treatments.We calculated the annual and cumulative number of planned enrollees of sample RCTs with a suboptimal control arm in mainland China.For trials that did not disclose their planned sample size, we relied on the actual number of participants enrolled as of 31 August 2022.The secondary outcomes were the potential predictors of the use of suboptimal control, and, for trials that have available results, the association between the adoption of suboptimal control and concluding statistical significance for the primary endpoint(s).

Data analysis
We used descriptive statistics to characterize the proportion of RCTs that used a suboptimal control arm for registration purposes in China, stratified by the year of their first ethical approval.To identify potential predictors of the use of suboptimal control, the univariable logistic regression, chi-squared test, and Fisher's exact test were performed to test differences between groups in categorical variables.Two-sided P values of < 0.05 were considered statistically significant.Factors found to be significant in univariable analysis were adjusted in the multivariable logistic regression model to examine subgroups with high odds of using a suboptimal control.All models were computed using STATA MP version 14.0 (StataCorp).Data were analyzed from October 2022 to September 2023.

Oncology RCTs using a suboptimal control arm
Of the 453 eligible RCTs, the control arm of 369 (81.5%) trials was categorized as optimal.The control arm of 24 (5.3%) trials was categorized as "potentially optimal," including 41.7% (10/ 24) multinational trials whose control group had been approved by the US FDA before receiving IRB approval in China, 25.0% (6/24) trials whose control group were cited as the global standard-of-care by the NCCN, and 33.3% (8/24) trials whose control regimens were later recommended by Chinese guidelines (see Table B in S1 Text for the details).
A total of 13.2% of RCTs (60/453) adopted a suboptimal control.The control treatment was not recommended by the relevant guideline in 36 cases (60.0%;Table 2); there was an alternative drug with a higher level of guideline recommendation in 21 cases (35.0%); and the control drug was not given in the recommended treatment combination in 4 cases (6.7%; see Table C  in   No statistically significant association was observed between the use of suboptimal control and concluding statistical significance on the primary endpoint (p = 0.208).

Discussion
In our analysis of 453 Phase II/III-III RCTs of new cancer drugs for registration purposes in mainland China in 2016 to 2021, we found that 13.2% of them adopted a suboptimal control arm.Approximately half of these were regimens not recommended by previously published clinical guidelines.The annual number of Chinese cancer participants who were randomized to receive suboptimal treatments in clinical trials totaled 18,610 by the end of 2021.Trials with suboptimal control reported higher but statistically nonsignificant proportions of positive results than those used optimal control.The use of suboptimal or inferior control in oncology trials has been increasingly concerning in recent years [5][6][7]10,11,34].Per the Declaration of Helsinki, clinical trials, whether initiated by an investigator or for registration purposes, should be conducted under prior ethical approval [4].Under Part 312 of the Code of Federal Regulations and FDA Amendments Act of 2007, the US FDA issued regulatory requirements for the control of investigational drug [35].Yet, evidence showed that 17% to 25% of superiority RCTs supporting FDA approval of cancer drugs in 2013 to 2019 used a substandard control arm [5,34].Similarly, we found that approximately one-eighth of RCTs for new cancer drug applications in China between 2016 and 2021 were conducted using a suboptimal comparator.Adoption of a control regimen known to be inferior to available therapies or not recommended by specific guidelines was the primary contributor, as found in this research and in the literature [5].Although it is challenging to compare regulatory outcomes across different settings and time periods, it seems that the proportion of RCTs registered in China with an optimal control was comparable to those in other developed countries, which suggests that trials registered in China are no less aligned with contemporary ethical standards than are in the US or European countries.
Adoption of a suboptimal control in RCTs is also prevalent in various diseases apart from oncology, such as rheumatology and cardiology [36,37].It could be explained from the perspectives of study investigators, regulators, and the landscape change of disease treatment.Since large-scale multicenter oncology trials are costly and entail a high risk of failure, trial sponsors are not always incentivized to conduct head-to-head studies of their product with the best-proven therapy [5].In our sample of RCTs, several investigated combination therapies against a control that has the same mechanism of action as the standard-of-care drug (e.g., almonertinib [an EGFR tyrosine kinase inhibitor] for untreated advanced EGFR mutationpositive non-small cell lung cancer [NSCLC]).A possible justification for this may be that authorized agents within a therapeutic class may have comparable effectiveness.Nonetheless, not comparing an investigational regimen against a proven best therapy generates suboptimal evidence.Our results also showed that compared with trials using optimal control, those adopting a suboptimal control showed a higher proportion of concluding positive results, which favored the pharmaceutical companies, though this was not statistically significant, and only 23.2% of sample trial results were publicly available with limited follow-up time.It was noteworthy that 83.9% (78/93) and 100.0%(12/12) of our sample RCTs with optimal and suboptimal control concluded positive primary endpoint(s) respectively, which was higher than those (51.4% [177/344] and 76.7% [33/43] of solid tumor trials published among 11 major oncology journals) reported in a recent literature [11].Given that this study focused on randomized oncology registration trials in China, one of the concerns is the selective reporting of results, geared toward those positive, may cause patients and regulators to exaggerate the clinical benefits of the investigational drugs.If this practice is widespread in the development pipeline, it may hamper therapeutic innovation and threaten the promotion of optimal clinical practice in the long term [8].
We observed a fluctuated but overall upward trend in the annual proportion of sample trials that used a suboptimal control.Compared with international multicenter RCTs, trials that recruited participants only in China seemed more likely to adopt an inferior control.A potential explanation is that trials initiated by multinational companies are more likely to recruit participants in high-income countries, and, thus, the proportion of their trials using a suboptimal control might be underestimated [38].Globally, with the emergence of new drugs replacing existing standard-of-care therapies and the update of clinical practice guidelines, the optimal therapy also changes over time and may differ across regions [39,40].Investigational new drug applications whose trials used a suboptimal comparator may distort regulators' decision-making and result in a potential waste of resources.In February 2022, the US FDA Oncologic Drugs Advisory Committee rejected the biologic license application of sintilimab for the first-line treatment of NCSLC.One of the committee's considerations was that its RCT used chemotherapy, rather than US-authorized immunotherapy, as the control arm [41].Building consensus on the selection of an appropriate comparator in oncology registrational RCTs is therefore important.Although China's Guidance on Clinical Value-Oriented Oncology Drug Research and Development issued in November 2021 emphasized patient-centered cancer drug research and development and pointed out that an active control arm should be selected with considerations of whether it reflects the optimal treatment in current clinical practices, its definition of "optimal treatment" is ambiguous [24].Therefore, despite that China's Medicinal Product Administration Law requires IRB approval and the regulatory agency's licensing for all registrational trials [42], the lack of high-level and harmonized criteria against which ethical approval can be made may allow for flawed designs in clinical trials.
The subgroup analysis, after adjusting for covariates, showed that adjuvant (mainly for lung cancer and hepatocellular carcinoma) and maintenance trials (mainly for ovarian cancer) were more likely to use suboptimal control.These findings could be explained by the evolving treatment landscape and discrepancies between that in China and in other regions.For high-risk Stage IB NSCLS, China's latest clinical practical guideline did not recommend adjuvant chemotherapy due to the absence of high-level evidence, while the NCCN Guideline recommended observation or adjuvant chemotherapy/osimertinib (for EGFR exon 19 deletion or L858R).For hepatocelluar carcinoma with high risk of recurrence, adjuvant transarterial chemoembolization after curative resection got a Grade-I recommendation in China's guideline (Level-of-evidence: 2A) with documented survival gains [43], while there was no global consensus on the treatment being a standard of care.For BRCA1/BRCA2 mutation-positive platinum-sensitive epithelial ovarian cancer, though poly ADP-ribose polymerase inhibitor has been recommended as the maintenance therapy since 2019, still, several placebo-controlled trials on next-in-class poly ADP-ribose polymerase inhibitor have been initiated subsequently.
Our findings also have important clinical implications.When a standard of care or an alternative treatment known to have superior benefit is available, being randomized into a suboptimal control arm may cause a patient to miss optimal care.Enrolling patients, especially key subpopulations, into a suboptimal control arm may also imply a waste of potential participant pool that could otherwise generate evidence to support future care.To address this issue, trial sponsors and investigators should shoulder the primary responsibility to ensure patient safety and trial validity.Clinicians should fully inform the trial participants about the benefits and risks entailed in their participation, not only of the investigational new drug but also of the authorized regimen in the control group.Moreover, although we observed a statistically nonsignificant effect of containing a Data Safety Monitoring Board on the adoption of suboptimal control in the multivariable model, setting a Data Safety Monitoring Board is also a feasible strategy to halt a clinical trial early and protect participants from receiving investigational drugs that were proven to lack therapeutic value in the interim analysis [44].
The strengths of our study are that we examined the quality of control arms of randomized trials evaluating the efficacy of investigational new cancer drugs, regardless of whether they have received market authorization, in this new era of China's oncology innovation.However, this study yields several limitations.First, 52 RCTs were excluded as there were no previously published Chinese guidelines to compare their controls against.Thus, the proportion of trials categorized as having an "optimal" control in this study might be conservative.Second, we used guidelines published prior to the date of a trial's initial ethical approval to evaluate the quality of their control arms.Some guidelines may not be available to some IRBs in a timely manner.However, among RCTs that used a suboptimal control, most (46 trials, 76.7%; Table F in S1 Text) were subject to clinical guidelines published 3 months or more before their ethical approval.Third, some guidelines may be subject to flaws, such that they were not updated timely or they expanded to include some options that were actually not relevant to the population being studied [45].In some CSCO Guidelines, treatments that are expensive but may have substantial benefits for the patients are also regarded as Grade II recommendations, which may bias the results on Category 3. Besides, although we used FDA approvals and NCCN recommendations to reevaluate the quality of control arm of multinational trials, clinical benefits and level of evidence supporting their approval and recommendation may have discrepancies and deficiencies [46,47].To mitigate these impacts, we invited several oncologists and clinical pharmacists to cross-check if our results were in line with their observations in actual clinical practices.Fourth, guidelines issued by expert committees on different specializations were developed according to varied principles, which might vary across types and time.This might bias the results of the univariable analysis.Fifth, we relied on the numbers of planned enrolment to estimate the number of trial participants at risk of receiving suboptimal treatments as two-thirds of the sample trials did not report the actual enrollment by the end of our observation.These numbers may deviate from the numbers of final trial recruitment.Sixth, publicly available data may represent a selective subset of trial information since only 23.2% of sample trial results were published by the end of our observation.Seventh, we only evaluated the quality of the control arm of RCTs and thus did not analyze the potentially inappropriate use of single-arm designs for conditions with existing standards of care.With the increasing number of nonrandomized oncology trials in China [22], further attention should be given to the rationality of using single-arm trials as the pivotal evidence for regulatory approval.Similarly, we only assessed the regimen rather than the dose or schedule of comparator arms.Further study may be necessary to evaluate the quality of the latter if a standard dose or schedule is built.Eighth, we only included trials conducted among adults due to the limited number of Phase III childhood cancer trials (only 4) and the poor availability of guidelines concerned with childhood cancer in China before 2021.Ninth, we only evaluated cancer drug RCTs, and, thus, the results may not be applicable to other types of therapeutic agents.Lastly, the study protocol and analyses were not prespecified in an open database.

Conclusions
Approximately one-eighth of randomized trials of cancer drugs for registration purposes in mainland China adopted a suboptimal control arm, and the number of trial participants at risk of receiving suboptimal cancer treatments in control arms increased over time.With the rising number of oncology trials registered in China, regulators should be cautious when making market authorization decisions for investigational new drugs that adopt suboptimal control in their pivotal trials.

Fig 1 .
Fig 1. Flowchart of sample oncology randomized clinical trials selection.Abbreviation: IRB, institutional review board.https://doi.org/10.1371/journal.pmed.1004319.g001 S1 Text for details).From 2016 to 2021, the annual proportion of trials that used a suboptimal control arm of all oncology registration trials fluctuated between 7.0% (3/40) and 20.0% (26/130; Fig 2A).The annual and cumulative number of trial participants at risk of exposure to suboptimal treatments are presented in Fig 2B.From 2016 to 2021, a total of 123,452 cancer patients were planned to be enrolled in the sample RCTs.The annual number of participants who would be assigned to receive suboptimal treatments in China increased over time.From 510 in 2016 and reached 7,476 in 2021.By the end of 2021, the cumulative number of trial participants in mainland China at risk of exposure to suboptimal treatments totaled 18,610, taking 15.1% (18,610/ 123,452) of the total number of all sample RCT enrolments.

Fig 2 .
Fig 2. Temporal trends of registrational randomized clinical trials of new cancer drugs used suboptimal control arms.(A) Annual numbers of oncology randomized clinical trials that used a suboptimal control arm in mainland China.(B) Annual and cumulative numbers of patients exposed to suboptimal treatment of oncology randomized clinical trials in mainland China.Abbreviation: IRB, institutional review board.Note: For the 5 trials that did not disclose their plan of patient enrolment, we used the actual number of participants as of 31 August 2022 alternatively.https://doi.org/10.1371/journal.pmed.1004319.g002

➢ Category 1. The control was not recommended by the concerned clinical practice guideline for a specific indication issued prior to the trial's ethical approval
➢ Category

2. The control drug or regimen was specified in the guideline but not the recommended regimen
e.g., In CTR20180332, a first-line therapy for biliary tract carcinoma, the comparator was gemcitabine in combination with oxaliplatin.According to the Guideline for Diagnosis and Treatment of Gallbladder Carcinoma (2015 Edition), gemcitabine in combination with cisplatin was recommended as the standard of care.In the later published Chinese Society of Clinical Oncology for Biliary Tract Cancer (2021 Edition), gemcitabine in combination with oxaliplatin only got a Grade of Recommendation II.
Fig 1 illustrates the process of trial identification.From January 1, 2016 to December 31, 2021, a total of 2,805 cancer drug trials for adult patients were approved by any IRB in mainland China.Based on the inclusion criteria, we included 453 Phase II/III and Phase III cancer drug RCTs.Of these, 78.6% (356/453) were compared against 54 CSCO guidelines to determine whether RCTs in our sample adopted a suboptimal control arm.For the other 21.4% (97/453) trials without a specific CSCO guideline available prior to their first ethical approval, we referred to a total of 29 clinical guidelines published by other Chinese academic societies (see Table A in S1 Text for further details).Table 1 shows the characteristics of the 453 eligible RCTs, which included 21 Phase II/III trials (4.6%) and 432 Phase III trials (95.4%).The annual number of cancer drug RCTs for registration purposes increased from 20 (4.4% of 453 eligible registration trials in the study time period) in 2016 to 130 (28.7%) in 2021.Around half of the trials (228/453, 50.3%) were sponsored by China's domestic companies.More than half of the trials (241/453, 53.2%) were indicated for first-line therapy, followed by second-line (105/453, 23.2%) and adjuvant therapy (39/453, 8.6%).Trials were mostly for the treatment of cancers of the lung (143/453, 31.6%),breast (68/453, 15.0%), stomach (34/453, 7.5%), liver (33/453, 7.3%), and prostate (25/453, 5.5%).Around half of the trials (251/453, 55.4%) were international multicenter studies, while 202 (44.6%) recruited patients from mainland China only.Across all 453 trials, the planned median number of participants in mainland China was 220 (interquartile range: 100 to 396 participants).

Table 1 . Characteristics of and potential factors associated with adoption of suboptimal control arm of randomized trials for investigational cancer drug applica- tions in China.
the preplanned results of 105 sample trials (23.2%).Among them, 105 reporting the initial trial results were included for data extraction.Trials mostly used progression-free survival (56/105, 53.3%) and overall survival (24/105, 22.9%) as the primary endpoint.Some studies (14/105, 13.3%) used overall survival and progression-free survival concomitantly as the primary endpoints (see Table D in S1 Text).Of the 93 trials that were deemed to have used an optimal or potentially optimal control, 78 (83.9%) reported statistically significant results while 15 (16.1%) concluded statistical nonsignificance (Table3; see Table E in S1 Text for details).Of the trials that were deemed as having a suboptimal control, all (12/12, 100.0%) reported statistically significant results.

Table 1 .
(Continued) a Unadjusted ORs were calculated using logistic regression.b P values were obtained from the univariable logistic regression, chi-squared test, and Fisher's exact test.c Adjusted ORs were obtained from the multivariable logistic regression model.Factors identified in univariable analysis were adjusted: year of ethical approval, recruitment region, line of therapy, and cancer site.https://doi.org/10.1371/journal.pmed.1004319.t001

Table 3 . Availability and statistical significance of sample randomized oncology trial results.
a P value was obtained from Fisher's exact test.b Of trials with publicly available results.

S1 PRISMA Checklist. PRISMA 2020 checklist.
S1 Text.Supporting information.Box A. Key words and research strategy to identify clinical practice guidelines other than Chinese Society of Clinical Oncology.Box B. Key words and research strategy to identify oncology trials.Table A. Characteristics of oncology guidelines used to evaluate the quality of trial comparator.Table B. Randomized oncology clinical trials with a potentially optimal control arm in China, 2016-2021.Table C. Randomized oncology clinical trials with a suboptimal control arm in China, 2016-2021.Table D. Primary endpoints used in sample randomized oncology trials with published results.Table E.Primary endpoint results and statistical significance of sample randomized oncology trials.Fig A. Use of suboptimal control arm in randomized controlled oncology trials in China, by applicable guideline type.Table F. Guideline published duration before the ethical approval of sample randomized controlled trials.(DOCX)